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The  objective  of  this  study  is  to  develop  and  test  two 
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technique  is  an  application  of  the^ Local  Search  Method  and 
the  second  technique  is  an  application  of  the  Franx-Wolfe 
Method.  The  motivation  for  looking  at  approximate  methods 
is  that  the  problem  is  NP-ccaplete  and  optimal  solution 
techniques  become  impractical  for  large  size  problems. 

Experiments  showed  that  the  Local  Search  Method  approach  is 
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an  efficient  technique  for  obtaining  approximate^ solutions. 
However,  the  Frank- Wolfe  Method  approach  does  not  perform 
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I.  INTRODUCTION 


A.  1  BE  PROBLEH 


The 

problem 

considered 

here 

is  the  search  for  a  moving 

target 

in 

discrete  time 

and 

space. 

where  there 

are 

constraints 

on 

the  searcher’s 

move  ment. 

The  target 

is 

assumed 

to 

move 

among  a 

finite 

set  of 

cells  C=  £  1 , . . . 

,N} 

according  to  a  specified  Markov  transition  matrix 
Z={z(i,  j)}.  The  target’s  motion  is  independent  of  the 
searcher’s  actions.  The  transition  matrix  is  known  to  the 
searcher  as  well  as  the  initial  distribution  of  the  target 
over  the  search  cells.  In  each  time  period  one  cell  is 
searched.  The  searcher  is  able  to  move  from  his  current 
cell,  say  i,  to  a  cell  which  must  be  selected  from  a  given 
subset  C  (i)  of  the  set  C.  Thus,  the  search  cell  in  a  given 
time  period  must  be  within  some  specified  neighborhood  of 
the  search  cell  in  the  previous  time  period-  If  the 
searcher  and  the  target  are  in  the  same  cell  i,  the  target 
will  te  detected  with  probability  g(i).  If  the  target  is 
not  in  the  cell  which  is  searched,  it  cannot  be  detected 
during  the  time  period.  The  objective  of  tae  search  is  to 
find  a  T-time  period  search  path  which  minimizes  the  prob¬ 
ability  of  non-detection  (PND)  - 

B.  BACKGROUND 

The  problem  of  searching  for  a  moving  target  in  discrete 
tire  and  space  has  received  considerable  attention.  rnc 
problem  is  difficult  because  of  its  complexity.  Trammel  and 
Weisinger  £  Ref.  1]  proved  that  optimal  constrained  path 
search  problem  for  a  stationary  target  in  discrete  time  and 
space  where  the  time  horizon  is  finite  and  the  measure  of 
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effectiveness  is  PND,  is  NP-Complete.  Since  the  stationary 
target  problem  is  NP-Complete,  the  moving  target  problem  is 
also  NP-Complete.  For  more  information  on  NP-complete  proo- 
lems,  see  [Ref.  2].  The  optimal  solution  techniques  which 
have  teen  used  to  solve  the  constrained  path  moving  target 
problem  are: 

1.  Total  enumeration 

2.  The  dynamic  programming  technique  of  Eagle  [Ref.  3]. 

The  total  enumeration  method  is  complete  enumeration  of 
all  possible  search  paths.  The  disadvantage  ox  this  aetnod 
is  the  exponential  increase  in  computer  time  as  the  problem 
size  increases.  However,  it  has  the  advantage  of  requiring 
very  little  computer  storage.  Eagle  formulates  the  problem 
as  a  Partially  Observable  Markov  Decision  Process  (PQMDPj  , 
and  the  method  requires  extensive  computer  storage,  bit 
finds  solutions  more  quickly  than  the  total  enumeration 
method. 

Since  the  problem  is  NP-Complete,  it  is  difficult  to 
solve  large  problems.  For  large  problems,  heuristic  or 
approximate  solution  techniques  have  seen  proposed.  Such 
metnods  were  developed  by  Stewart  [Ref.  4]  and  Eagle 
[Ref-  5  ]. 

Stewart  developed  a  br anch-and-bound  algorithm  tor  the 
solution  of  the  problem.  However,  optimality  cannot  ve 
guaranteed  because  exact  bounds  cannot  be  obtained. 
Never tmess,  Stewart  used  one- di mensionai  a  random  walk  as  a 
test  problem  and  demonstrated  tnat  tne  algorithm  performs 
efficiently. 

Eagle's  approximate  procedure  is  a  simpler  version  of 
his  optimal  dynamic  programming  method.  Euqle  usea  moving 
horizon  policies  and  also  looked  for  a  lower  bound  for  tne 
minimal  PND.  Eagle's  computational  experience  with 
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two-dimensional  search  problems  showed  the  m-tiae  period 
moving  horizon  policies  (m-TPMH)  do  not  necessarily  perform 
better  as  m  increases.  Nonetheless,  the  method  does  show 
some  premise.  The  m-TPKH  policy  selects  as  the  next  search 
that  cell  wnich  would  be  optimal  if  m-time  periods  remained 
in  the  problem. 

Recently  Eagle  and  Yee  developed  a  new  approximate  solu¬ 
tion  method  by  using  the  convex  simplex  method  [fief.  6], 
Two-dimensional  computational  experiments  showed  that  the 
method  performs  well. 

In  this  thesis  two  new  approximate  solution  techniques 
will  te  studied  and  tested.  The  first  method  is  a  heuristic 
approach  which  is  an  application  of  the  Local  (Neignhorhood) 
Search.  The  second  technique  is  an  application  of  the 


II.  FORMULATION  OF  THE  PROBLEM 


In  this  chapter  we  will  formulate  the  problem  as  a 
nonlinear  program. 


A.  DEFINITION  OF  SYMBOLS 


T  :  Number  of  time  periods. 

N  :  Number  of  cells. 

g (i)  :  Prob  [detecting  the  target  J  target  and  searcner 

are  in  cell  i} . 

Z  =  [z(i,j)}  is  an  NxN  Markov  transition  matrix  where  tne 
(i,j)th  element  is  the  probability  that  the  target  in  cell 
i  at  time  period  t  will  move  to  cell  j  at  time  period  t+ 1 . 

x  (t)  =  [x(1,t). . ,  x  (N , t) )  represents  the  searcher 

probability  distribution  at  time  t.  That  is,  x(i,t) 
denotes  the  probability  of  the  searcher  being  in  cell  i  at 
time  period  t.  At  the  start  of  the  search,  the  searcher 
cell  is  assumed  to  be  known  with  certainity,  i.e.,  x(1) 

consists  of  1  one  and  all  others  zero. 


P,(t)  .=  [p{1,t),... - ,p(K,t)}  represents  the  target  prob¬ 

ability  distribution  at  time  t.  That  is.  p(i,t)  is  the 
probability  target  is  in  cell  i  at  the  begmino  of  time 
period  t  without  being  detected  by  the  previous  t-1 
searches.  The  initial  target  distribution  p(1)  is  assumed 
to  be  known  by  the  searcher. 


R(i.j,t)  is  the  probability  that  the  target  is  in  cell  i 
without  being  detected  by  the  previous  t-1  searches  and 
the  searcher  is  in  cell  j. 

S(t)  =  [S(i,j,t)}  is  an  NxN  Markov  transition  matrix  for 
the  searcher.  The  (i.j)th  element  is  zero  if  subset  C(i) 
does  not  include  j  (patn  constraints) - 


S  = 

inclu 

given 


(S(1) 

des  a 
that 


, . .. . ,S (T-1) }  is  called  a  search  Dlan  whic 
II  possible  searcher  motions  for  T-time  period 
the  searcher  star  tiny  cell  is  known. 


h 


B.  NIP  FORMULATION  OF  THE  PROBLEM 

New  we  neea  to  compute  x(t)'s  and  R(i,j,t)'s.  Since 
x  (1 )  is  known,  we  can  determine  x(t)  by  the  Markovian  motion 
as  shewn  below: 


x{t)  =  x  (t—  1 )  S  (t-1)  ,  t=2  ,  T. 


The  B(i,j,t)  consists  of  two  Markov  processes.  Note  that 
R(i,  j,1)  is  assumed  to  be  known.  So,  the  B(i,j,t)  can  be 
computed  as  follows: 

B(i.j,t)  =  {1-q  <i)d(i,j))  B  (k,l,  t-1)  z  (k,i)  S(l,  j,t-1) 

k.L 

i#  j  ,  k,l=  1,2, ,  N  and  t=  2,  .  ,T 

where  d(i,j)  is  one  if  i  equals  j,  zero  otherwise. 
Therefore,  given  P(1),  q(i),  S,  and  Z,  the  T-time  prob¬ 

ability  of  nondetection  is 

PhD  B  (i,  j,  T)  ,  i,  j=  1,  2,..  .  ,h- 

t T 

He  want  to  fina  the  search  plan  S  which  minimizes  the 
T-time  period  PhD,  subject  to  the  path  constraints.  The 
final  NLP  form  of  the  problem  is  given  in  Table  1.  The 
foliowing  properties  of  the  NLP  were  proven  by  Eagle  and  Yee 
[fief.  6], 

Proposition  1:  The  minimum  of  the  NLP  is  achieved  by  a 
deterministic  search  plan.,  A  deterministic  search  pian 
consists  of  ones  and  zeros. 

Proposition  2:  S  is  a  deterministic  search  plan  if  and 
only  if  S  is  an  extreme  point  of  the  linear  constraints. 

Proposition  3:  The  objective  function  is  linear  in  S 

wnen  constrained  to  any  edge  of  the  simplex. 


TABLE  1 

HIP  FOBHULATION  OF  THE  PfiOBLEfl 

aia  PND 
subject  to: 

S(t)  1=1  ,  t=1,...f T-1 

S(t)  >  0  ,  t=1,...,T-1 

S(i,j,t)  =  0  ,  t=1 , . ,T-1 

i  If* •  •  f  N 

it  c(i) 


III.  THE  LOCAL  SEAHCH  ALGORITHM 


The  optimal  solution  techniques  for  hard  combinatorial 
optimisation  problems  require  more  computer  time  when  the 
size  of  the  problem  increases.  Therefore,  they  become 
difficult  to  implement  for  large  size  problems.  One  of  the 
most  succesful  methods  of  attacking  them  is  the  Local  Search 
or  Neighborhood  Search.  However  unsatisfying  mathemati¬ 
cally,  this  approach  is  certainly  valid  in  practical  situ¬ 
ations.  The  main  shortcoming  of  the  method  is  that  there  is 
no  criterion  to  tell  whether  the  obtained  solution  is  a 
global  optimum.  The  local  search  method  is  most  applicable 
for  optimization  in  two  main  types  of  problems: 

1.  When  the  analytic  relationship  of  the  independent 
varianles  and  the  objective  function  is  not  known, 
but  the  value  of  the  objective  function  can  be  evalu¬ 
ated  at  individual  points  by  experiments. 

2.  When  the  analytic  form  of  the  objective  function  is 
known  but  there  is  no  finite  algorithm  for  obtaining 
the  extreme  value  (s)  in  a  closed  form. 

The  efficiency  of  the  method,  relative  to  another,  is 
defined  in  terms  of  a  suitable  cost  function  such  as  number 
of  points  or  experiments  required  for  localizing  the  optimum 
witnin  a  specified  range.  one  of  the  best  known  illustra¬ 
tions  of  this  technique  is  the  traveling  salesman  problem 
(TS?)  where  the  objective  is  to  find  tne  shortest  pitn 
passing  through  each  of  a  number  of  points  exactly  once  and 
then  returning  to  the  starting  point.  For  other  examples 
refer  to  [ Ref.  7 ]. 

Since  the  problem  presented  in  the  previous  chapter  is 
NP-conplete  and  the  current  optimal  solution  techniques  are 
impractical  for  large  size  problems,  we  can  try  to  apply  the 


local  search  nethod  as  a  heuristic  approach  for  good 
approximate  solutions. 

A.  I BE  ALGOB1THB 

First,  we  will  define  some  concepts  in  order  to  intro¬ 
duce  general  local  search  algorithms  and  tnen  apply  this 
method  to  the  constrained  path  moving  target  search  pronlem. 

Definition  1:  An  instance  of  an  optimization  problem  is  a 
pair  (F,c)  where  F  is  any  set,  the  domain  of  feasible 
points,  and  c  is  the  objective  function,  a  mapping 

a  F — >  a1 

Definition  2:  Given  an  optimization  problem  with  instances 
(F,c)  ,  a  neighborhood  is  a  mapping 

H:  F— >  2* 

defined  for  each  instance. 

The  general  local  search  algorithm  is  described  as 
follows;  Given  an  instance  (F,c)  of  an  optimization  problem 
(minixizing)  and  an  initial  feasible  point  s,  we  search  the 
neighborhood  N  (s)  for  an  m£N{s)  with  c(m}  <  c{s).  So,  we 
start  with  an  initial  feasible  point  s  and  attempt  to 
improve  the  objective  function  by  searching  the  neighborhood 
of  s.  If  an  improvement  is  found,  another  search  is  made  in 
the  neighborhood  of  the  improved  point.  This  continues 
until  nc  improvement  can  be  made. 

Since  we  know  that  the  solution  of  the  NLP  is  aa  deter¬ 
ministic  search  plan  (proposition  1)  and  it  is  assumed  that 
the  searcher  starting  cell  is  known,  we  can  reduce  our 
feasible  region  to  search  paths  s= (s ( 1 ),..., s  (T) } ,  where 
s(t)  is  tne  searcner  cell  at  time  period  t.  Therefore,  we 
can  start  with  an  initial  feasible  search  path  s,  an  objec¬ 
tive  function  value  PND  (s)  ,  and  attempt  to  find  a  searcn 
path  m  in  a  neighborhood  of  s  such  that  PND(m)  <  PND  (s)  .  we 
define  the  k-change  neighborhood  of  search  path  s  as  all 
feasible  search  paths  m  which  are  identical  to  s  except  in  k 
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consecutive  tine  periods.  So,  the  algorithm  for  the  problem 
becomes : 

Step  1.  Start  with  an  initial  feasible  search  path  s. 

Step  2.  Find  the  all  possible  k-change  neighborhood  paths 
by  removing  k  consecutive  cells  from  s  (keeping  the  others 
unchanged)  then  replacing  them  with  k  new  cells  satisfying 
the  path  constraints. 

Step  3.  Find  the  k-change  neighborhood  path  m  with  the 
minimum  PND  (m)  . 

Step  4.  If  PND(m)  <  PND(s),  set  s=m  and  go  to  step  2. 
Otherwise,  STOP;  current  s  is  k-optimal. 

The  most  difficult  task  in  any  application  is  to  decide 
of  the  proper  value  of  k  for  the  k-change  policy.  Selecting 
the  rignt  k  leads  to  very  effective  heuristics  for  the  T5P 
(Ref.  7].  'we  will  test  the  present  algorithm  for  k=1,2  ana 


B.  INITIAL  FEASIBLE  SEARCH  PATH 

The  algorithm  requires  two  stages.  First,  determine  the 
initial  feasible  starting  search  path  and  then  apply  tie 
procedure  to  it.  The  initial  feasible  point  may  be  chosen 
randoaly  or  it  may  be  carefully  constructed.  In  practice  we 
need  a  quick  and  a  good  approximate  solution.  We  do  not 
want  to  be  far  away  from  the  optimal  when  we  start.  In  this 
study  we  will  use  the  modified  myopic  policy  (rlMP)  to  deter¬ 
mine  an  initial  feasible  starting  path.  The  myopic  policy, 
which  gives  optimal  solution  for  a  stationary  target  proo- 
lems,  always  searches  in  the  next  time  period  t,  tne  cell  i 
which  has  the  largest  probability  ox  detecting  tne  target, 
(q (i) p (i,t)  }  .  The  M  HP  is  defined  as  follows. 

For  the  next  time  period  t,  searcher  moves  from  his 
current  cell  i  to  that  accessible  cell  j  which  has  tne 
largest  q(j)p(j,t)  value.  If  all  accessible  ceils  j  have 
identical  values  of  g(j)p(j,t),  then  the  searcher  will  move 
to  the  accessible  cell  which  has  the  minimum  Euclidian 


distance  to  the  cell  k  having  the  largest  g(k)p(k,t)  value. 
If  the  Euclidian  distances  are  equal,  these  ties  are  broken 
randomly.  There  is  probably  a  smarter  technique  for 
breaking  ties. 

The  mmp  is  a  heuristic  construction  meant  to  produce  a 
good  starting  path,  because  the  neighborhood  k-change  proce¬ 
dure  may  not  be  very  powerful.  He  will  also  test  the 
(k- 1) -optimal  solution  as  a  starting  path  for  the  k-change 
policy. 


I?.  COjJPOTA^IO NAL  EXPEDIENCE 


Our  cooiputatioaal  experience  is  based  on  two-dimensional 
search  problems.  All  experiments  presented  in  this  chapter 
were  performed  on  an  IBM  3033  mainframe  computer  using 
Fortran  77.  The  Local  Search  Algorithm  was  used  to  solve 
three  10-time  period  search  problems,  where  N=9 ,  25  and  49. 
For  each  problem,  values  of  k=1,  2  and  3  were  used.  The 
constraints  on  the  searcher  and  the  target  paths  are  defined 
as;  the  searcher  (target)  is  able  to  move  to  the  cell  previ¬ 


ously  searched  (occupied)  plus  all  adjacent  cells.  Cells 
are  adjacent  if  they  share  a  common  side.  For  example,  in 
Figure  4.1  the  adjacent  cells  of  cell  1,  4  and  5  are: 

C  ( 1)  =  {1*2,4}  ,  C  (4)  =  {  1, 4,5,7}  ,  C  (5)  =  {2, 4 , 5,6 , 8} 

The  target  transition  matrix  is;  the  target  remains  in  the 
previously  occupied  cell  with  probability  0.4,  and  moves  to 
the  adjacent  cells  with  probability  0.6/m  whete  m  is  the 
number  of  adjacent  cells.  The  probability  or  detection  is 
1.0  fer  each  cell,  i.e.,  g(i)  =  1.0  ,i-1,...,N. 

A.  3X3  PROBLEH 


Figure  4.1  9  Cell  Search  Grid. 
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In  this  problem  the  target  moves  among  the  9  cells  shown 
in  Figure  4.1.  The  searcher  starts  in  cell  1  and  the  target 
in  cell  9 ,  i.e. ,  initial  target  distribution  is  that  the 
target  is  in  cell  9  with  probability  1.0  and  in  the  other 
cells  with  probabiliy  0-  The  10-time  period  search  results 
are  shown  in  Table  2.  An  optimal  solution  was  obtained  for 
all  k=1,  2,  3.  However  CPO  time  increases  exponentially  as 
k  increases.  As  can  be  seen,  the  MMP  solution  is  very  close 
to  the  optimal.  The  Fortran  code  for  this  problem  is  given 


in  Appendix  A. 


TABLE  2 

3x3  PROBLEM  EESULTS 

Search  Path  PND 

Nyopic  4585658565  0.2328 

k  =  1  4589658565  0.  2214 

k  =  2  2  589658565  0-  2214 

k  =  3  2  589658565  0.  2214 

OFTIMAL  PND  =  0.2214 


CPU 

Time  (sec) 


0.51 
3.  10 

26.18 


B.  5X5  PROBLEM 

In  this  example  the  target  and  the  searcher  moves  among 
25  cells  (Figure  4.2).  The  searcher  starts  iL  cell  1  ana 
the  target  starts  in  cell  13  with  certainty.  The  10-time 
period  search  results  are  shown  in  Table  3. 

We  found  an  optimal  solution  only  for  k=3,  but  solutions 


2  3 


n 

8 

9 

10 

ITT 

13 

14 

15 

17 

18 

19 

20 

22 

23 

24 

25 

TABLE 

3 

5x5 

PROBLEM 

RESULTS 

Search 

Path 

PND 

CPU 

Time  (sec) 

M  yopic 

6 

7 

12 

13 

14 

13  18 

13 

14  13 

0.5099 

k  =  1 

6 

7 

12 

13 

14 

19  18 

13 

8 

9 

0.  4907 

1.09 

k  =  2 

2 

7 

12 

13 

8 

13  18 

19 

14 

9 

0.4887 

10.09 

k  =  3 

6 

7 

8 

13 

12 

17  18 

19 

14 

9 

0. 48  at> 

75.  23 

OPTIMAL 

PND  = 

0. 

4886 

differs  from  tne  optimal  solution  omy  in  the  rourtn  digit. 
Similar  to  the  3x3  problem  the  MMP  solution  is  close  to  the 
optimal  and  CPU  time  increases  exponentially. 

C„  7X7  PROBLEM 


In  this  proDien  the  target  and  the  searcher  moves  among 
49  search  cells  shown  in  Figure  4.3.  The  searcher  starts  in 
ceil  1  and  the  target  starts  in  cell  17.  The  10-time  period 


search  results  are  shown  m  Table  4.  Me  obtained  the 
optimal  solution  for  only  k=3.  The  percentage  difference 
between  the  MMP  solution  and  the  optimal  solution  is  only 
1.2  K.  For  k=1  and  2  same  result  were  obtained. 
Exponential  increase  in  CPU  time  is  more  steep  than  the 
previous  problems. 

In  addition,  the  total  enumeration  method  was  used  to 
find  all  optimal  paths  for  each  problem.  The  results  are 
shown  in  Table  4. 
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Figure  4.3  49  Cell  Search  Grid. 

In  tact,  for  the  5x5  and  7x7  problems  we  increaseu  the 
search  area  of  the  3x3  problem  witn  tne  same  target  and 
searcher  starting  cells  and  the  target  transition  oatrix. 
For  each  problem  a  similar  pattern  was  observed  tor  optimal 
paths.  Specifically,  the  searcr.er  goes  to  the  target's 
starting  cell  as  soon  as  possible,  tuen  starts  to  search 
outside  of  tuis  cell  similar  to  the  expanding  square  search. 
Graphical  representation  of  exponential  increase  in  CP J  time 
as  k  increases,  is  shewn  iu  Figure  5.  1. 
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TABLE  4 

7x7  PROBLEM  BESULTS 

CPU 


Myopic 

2 

9 

10 

Search 

17  24  17 

Path 

16  17 

10 

1 1 

PND 

0.50  66 

Time  (sei 

k  =  1 

2 

9 

10 

17  24  23 

16  17 

18 

1 1 

0.5063 

1.33 

k  =  2 

2 

9 

10 

17  24  23 

16  17 

18 

1  1 

0. 50  63 

9.55 

k  =  3 

2 

9 

16 

17  24  17 

18  11 

10 

9 

0.5005 

1  17.73 

OPTIMAL  PND 

=  0-5005 

TOTAL  ENUMERATION  RESULTS  1. 
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Figure  4.4  CPU  Tine  vs  k-change  Policy 


D.  HCDIFIED  MYOPIC  SCIOTIOS  BESOLTS 

The  reason  for  using  the  MMP  was  to  find  a  near  optimal 
starting  solution.  Ihis  objective  was  met  in  the  problems 
shown  so  far.  In  these  problems,  the  mean  position  of  the 
target  does  not  move,  given  no  search.  In  order  to  examine 
the  possible  effects  of  a  moving  mean  target  position,  two 
5x5  search  problems  were  solved  with  different  transition 
matrices,  initial  target  distributions,  and  detection 
probabilities. 

1 •  Zist  Target  Problem 

In  this  problem  the  target  starts  in  cell  13  and  the 
searcher  starts  in  cell  1.  The  target  transition  is  such 
that  the  target  stays  in  the  previously  occupied  cell  with 
probability  0  and  moves  to  the  adjacent  cells  with  prob¬ 
ability  1/m  where  m  is  the  number  of  adjacent  cells.  The 
detection  probability  is  1.0  for  each  cell.  The  10-time 
period  search  results  are  shown  in  Table  5. 


« - T 

TABLE  5 

5x5  FAST  TARGET  PROBLEM  BESOLTS 

CPU 

Search  path  PSD  Time  (sec) 


My  epic 

2 

7 

8 

8 

13 

18 

13 

18 

13 

8 

0.4770 

k  =  1 

2 

n 

7 

1  2 

17 

18 

19 

1h 

9 

8 

0-374  2 

k  =  2 

2 

7 

7 

12 

17 

18 

19 

14 

9 

■) 

0.37  4  2 

k  =  3 

A- 

7 

7 

8 

13 

12 

17 

18 

19 

14 

0.3779 

OPT 

IMAL 

FND  = 

0. 

3  742 

1.8 

10.1* 

67.93 


In  tms  case  the  MMP  dad  not  perform  as  well  as  it 
did  in  the  previous  5x5  problems-  An  optimal  solution  was 
obtained  for  k=1 ,  2.  Additionally,  k=3  policy  did  not  reach 
the  optimal  solution  while  requiring  more  CPU  time. 

2.  Escaping  Target  Problem 

For  this  problem,  the  target  starts  in  cell  21.  It 
then  stays  iu  the  current  cell  with  probability  0.1  and 
moves  one  cell  up  or  tc  the  right  with  probability  0.45.  If 
it  reaches  one  of  the  top  boundary  cells  (  1,  2,  3,  4  )  or 
one  of  the  right  boundary  cells  (  25,  20,  15,  10  ),  then  it 
will  move  one  cell  tc  the  right  or  one  ceil  up  with  prob¬ 
ability  0.9  and  it  remains  in  the  current  cell  with  prob¬ 
ability  0-1-  When  it  reaches  cell  5  it  will  stay  there 
forever  and  is  assumed  to  have  escaped.  That  is,  the  proa- 
ability  of  uetection  in  this  cell  is  0,  while  for  the  otuer 
cells  the  probability  of  detection  is  1.0.  The  10-time 
period  search  results  are  shown  in  Table  6.  The  MflP  path 
has  significantly  greater  PND  than  the  optimal  path  even 
though  it  differs  in  only  one  time  period  from  an  optimal 
path.  Optimal  solutions  were  obtained  for  k=1,  2,  3. 

For  the  last  two  problems  all  optimal  paths  were 
obtained  by  total  enumeration  and  are  shown  in  Table  6.  In 
the  fast  target  problem,  the  optimal  search  path  placed 
search  effort  around  the  targets  starting  cell.  If  target 
moves  in  a  specific  direction  (escaping  target  problem)  cnis 
reduces  the  number  of  possible  optimal  paths.  In  this  case, 
optimal  paths  put  a  barrier  in  front  of  the  target. 

E.  INCREASING  THE  NUBBEB  OF  TIME  PEHIODS 

Tc  examine  the  effect  of  increasing  the  number  of  time 
pericds  on  CPU  time,  5x3  problem  was  solved  for  15,  20,  25 
and  3C  time  periods.  The  grapnical  results  are  shown  in 
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TABLE  6 

ESC API  MG  TARGET  PROBLEM  RESULTS 


Myopic 

6 

11 

Search  Path 

12  12  13  14 

15 

15 

10 

10 

PND 

0.2580 

CPU 

Time  {sec) 

k  =  1 

6 

1  1 

11 

12 

13 

14 

15 

15 

10 

10 

0.1530 

0-68 

k  =  2 
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15 
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10 
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k  =  3 

1 

6 

11 
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10 

0. 1530 

1  8.4  6 

OPTIMAL  PND  =  0.1530 


TOTAL  ENUMERATION  RESULTS  2- 
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Figure  4.5  for  k=1,  2,  and  3.  For  T=30  and  k  =  3  prograa  was 
stopped  at  3600  seconds  CPU  time.  The  increse  in  CPU  time 
for  k=1  was  considerably  less  than  for  k=2,  3.  We  can  say 
that  k=1  policy  was  the  most  CPU  TIME  /  (1-PND)  effective. 

Fcr  the  presented  problems  we  also  tested  the 
(k-1) -change  optimal  solution  as  a  starting  path  for  the 
k-change  policy  where  k=2.  But  starting  with  this  alterna¬ 
tive  path  did  not  improve  the  solution  obtained  by  using  a 
MMP  starting  path. 


Figure  <4.5  Time  Periods  vs  CPU  Time 


V.  FRANK— fOLFE  ALGORITHM 


Another  method  applicable  to  the  problem  is  the 
Frank-Wolfe  (F-W)  algorithm.  The  main  motivation  of 
selecting  this  algorithm  is  that  this  method  implicitly 
examines  all  extreme  Feints  of  the  convex  polyhedron,  rather 
than  just  the  k-change  ones.  In  1956  Marguerite  Fran*  and 
Philip  Wolfe  proposed  this  method  for  solving  non-linear 
programs  having  a  convex  differentiable  objective  function 
and  linear  constraints,  since  our  objective  function  is  not 
convex  this  method  will  determine  an  approximate  solution  to 
the  problem. 

The  F-W  algorithm  is  a  feasible  direction  method  ana  may 
simply  stated  as  follows;  Given  a  feasible  point  at  any 
iteration,  an  improving  feasible  direction  is  determinea  by 
linear  program  (L?) .  The  objective  function  of  the  hr  is 
formed  by  using  a  linear  approximation  (first  order  Taylor's 
expansion)  of  the  objective  function  of  the  NLP  and  tne 
constraints  are  the  original  linear  constraints  of  the  NIP. 
Then  the  step  size  is  determined  by  a  line  search.  Ihe 
algorithm  continues  until  no  direction  is  found  to  improve 
the  objective  function.  For  further  information  refer  to 
ffief.  8], 

A.  A  FPL  IC  AT  ION  OF  F-H  METHOD 

Given  S,  x  (t)  ,  P(t),  q(i),  and  Z,  the  objective  function 
can  be  written  for  each  time  period  t  as  follows: 

PND<S)=^T.  p(i,t)  (1-q(i)x(i,t))z(i,  j)  v(j,t*1) 

i,  j=  1 , 2, . .  N  and  t=1,2, . ,T 
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where  v(i,t)  is  the  probability  that  the  target  is  in  cell  i 
at  the  beginning  of  time  period  t  and  will  not  be  detected 
by  the  remaining  searches.  Ue  can  compute  v(i,t)*s  in  a 
backward  recursive  manner  as  fellows: 


v  (i,T+1)  =1-  0  #  i=1,...,H 

fH(i»x(i*t)}z(i/i)»<j*tt1) 

TECU) 

i=1 1 |li  and  t~1,2,««..,T 

Since  P(1)  is  known,  the  p{i,t)  's  can  be  computed  by  the 
forward  recursion 


P(j.t>1)  = 


P(i#t)  |1-g(i)  x  (i,t)}z(i,  j) 


i,  j=1  r  2,  ..  ...  ,H  and  t=1,2,.....,T-1 


For  a  given  search  plan  S  the  p(i,t)  and  v(irt)  will  be  the 
same  for  each  time  period.  So,  we  need  to  compute  them  once 
for  each  search  plan  S. 

Since  x(j,t)=  x  (i,  t-  1 )  S  (i,  j,  t-  1)  ,  then  tne  gradient 
vector  for  time  period  t  can  be  computed  from  the  following; 


3PNDU) 

asii.j.o 


=-x(i,t) p( j,t*1) 


y~  q  (i) 

WEC(j> 


z(  j,k)  v  (k,t*2)  . 


,H  and  t=  1, 2 


iO 


i  »  j=  1  *  2 


1 


Then  the  feasible  direction  of  descent  is  found  by  solving 
the  IE  sub  problem  shown  in  Table  7.  As  we  explained  before 
the  constraints  of  the  LP  must  be  the  same  as  the  NLP's 
constraints.  Note  that  the  IE's  constraints  in  Tatle  7  is 
another  way  of  expressing  the  constraints  in  Table  2.  The 
solution  of  this  LP  subproblems  is  trivially  found  as 
follows;  For  each  i  and  t,  choose  j  C  (i)  wita  minimum 
Y(i,j,t),  call  it  j  then  set  M(i#j  ,t)  =  1  and  N(i,j,t)=0  for 
i  =  j  - 


TABLE  7 
LP  SOBPfiOBLES 


Y(i,j,t)  N(i,j,t) 


.%  J 


subject  to: 

J~  A  (i,  j  ,  t)  =  1  ,  i=1r N 

ilZu)  t_1 . T  1 


A  (i,  j,t)  *0 


i — 1  , . •  .  ,  N 


Ihis  solution  is  an  extrema  point  of  the  linear 
constraints.  Therefore,  solution  of  the  LP  is  deterministic 
search  plan  3  which  defines  a  uaigue  searcn  path  m.  Since 
we  are  only  interested  in  deterministic  search  paths,  we 
cnoose  the  step  size  as  1  if  PND(m)  <  PND(s)  and  zero  other¬ 
wise,  ie.,  tne  process  is  terminated  when  PND(m)  >  PND(s). 
So,  the  second  algorithm  becomes: 


Step  1.  Select  an  arbitrary  feasible 
s=  fs(1),..,s<T-1). 


search  path 


Step  2.  Determine  a  new  search  path  m  by  solving  the  LP 
sub  problem. 

Step  3.  If  PMD(m)  <  PND(s)  set  s=m,  go  to  step  1. 
Otherwise,  STOP. 


B.  CCMPUTATIOMAL  EXPEBIENCE  FOB  F-R  METHOD 

Re  applied  the  algorithm  tc  the  3x3  problem  (defined  in 
Chapter  4)  with  30  randomly  selected  starting  search  paths 
(myopic  search  path  included).  The  algorithm  did  not  reach 
the  optimal  solution.  For  7  of  the  30  paths  (myopic  path 
was  one  of  them)  the  algorithm  did  not  improve  the  starting 
solution.  The  closest  solution  to  optimal  (0.2214)  was 
0.2328  which  is  the  myopic  path  result.  The  maximum  and 
minimum  CPU  times  were  0.04  and  0.11  seconds,  respectively. 
Ihe  results  are  shown  graphically  in  Figure  4.4.  The 
Fortran  code  of  the  algorithm  for  the  3x3  problem  is  given 
in  Appendix  B. 


¥1.  COHCIOSIOaS 


He  have  investigated  the  effectiveness  and  computational 
efficiency  of  the  Local  Search  Method  and  the  Frank-Wolfe 
Method  for  several  two-dimensional  search  problems. 

The  heuristic  Local  Search  Method  appeared  clearly 
satisfactory  for  the  examined  search  problems.  However,  tne 
exponential  increase  in  CPU  time  will  limit  the  use  of  the 
method  for  higher  k  values.  Also  increasing  k  does  not 
necessarily  improve  the  solution.  This  procedure  appears  to 
be  useful  because  it  allows  a  trade  off  between  solution 
accuracy,  i.e.,  closeness  to  the  optimal  search  path  and  CPU 
time.  For  further  analysis  this  method  can  be  tested  for 
different  problems,  k-change  policies  and  number  of  txae 
periods. 

The  Frank-Wolfe  method  approach  did  not  perfora  well  :or 
the  problems  examined.  An  alternative  way  of  improving 
efficiency  of  this  algorithm  may  be  to  perform  a  line  search 
after  determining  the  feasible  direction  of  descent.  But 
this  would  increase  the  CPU  time.  Both  methods  are  also 
applicable  to  Brown's  original  problem  [ Eef .  9]  and  they  may 
be  efficient  for  this  problem  because  of  its  convex  objec¬ 
tive  function. 


APPENDIX  A 


FORTRAN  CODE  OF  LOCAL  SEARCH  ALGORITHM 


C  X********************************************* 
C  *  METIN  SAGAL  * 

C  *  THIS  PROGRAM  APPLIES  LOCAL  SEARCH  * 

C  »  ALGORITHM  TO  3X3  PROBLEM  FOR  K=I.  * 

C  ****xxx***x**xxx*xxx*xxxxx**xx*x*x*****xx**xx* 
C 

INTEGER  T.NN,P<400.30  ) , TIC  50) , SC  50 ) , C( 25 , 25 ) 
INTEGER  AA ( 9 , 5 ) , I N I  9  ) 

REAL  P  P  (  2  0  ) ,  P  B  (  50 ) , BBC  50) . XM I N , PND 
C 

C  XXXXXXXXXXXXXXXXXXXXXXXKXXXXXXXXXXXXXXXXXXXXXX 

C  *  INPUT  x 

C  T-T IME  PERIODS 

C  NN  = DOF  SEARCH  CEILS 

C  S -  ST  ART  I NG  SEARCH  PATH 

C  1 N  =  80F  ADJACENT  CELLS 

C  A  - ADJACFNT  CEI  LS 

C  ^CONSTRAINT  MATRIX 

C 

RE  A  DC  5. 100)  T.NN 

100  FORMAT (312) 

READC  5  , 103)  ( SCI), 1=1. T) 

103  FORMAT  C 1 1 1 1 ) 

READ! 5.101)  CINCI),I=1. NN  ) 

101  FORMAT (911) 

READ( 5. 102)  AAC I , J ) , J  =  1 , 5 ) . 1  =  1 . NM ) 

102  FORMAT (511) 

READC  5.104)  C  CCC  l  ,  J  1 .  J  =  1 , NtU  .1  =  1, NN 1 
10  4  FORMA  TC  9  I  2  ) 

C 

C  *x*x*  TARGET  INITIAL  PROB.  DISTRIBUTION  ****** 
C 

DO  15  K  =  1 .NN 
15  P  B ( K ) =  0 

P  B  C  9  )  =  1 
DO  2  5  K  =  1 .NN 
25  B  B  C  K  >  =  P  B  C  K  ) 

C 

C  ***.**»**  FIND  PND  FOR  STARTING  PATH  S  ******* 
C 

DO  35  1=1.10 
35  Z( I  )=SC  1  +  1  ) 

CALL  PROBCZ , PB, T , NN. BB , PND) 

XM I N  =  PN  D 
C 

C  **********  FIND  NEIGHBORHOOD  PATHS  *********** 
C 

999  MM  M  =  0 
TT  =2 

3  33  K  INCSCTT-m 
DO  10  I  =  1  .  K 

ZC  TT -1 ) =AA( S( TT  -  1  )  ,  I  ) 

C 

C  **********  CHECK  PATH  CONSTRAINTS  »*»******»»* 
C 

IF(C(Z( TT  —  I  ) , S( T  T ♦  1  ))  t  Q  .  0  )  GO  TO  10 
C 

c  »«***»**»*  find  PND  FOR  NEW  PA  1 H  »»*•*«*•*«»** 

C 

l  ALL  PROBCZ. Pb. T .NN. BB . PND ) 


35 


nno  rj  nnn  i_n  nnnn  nnn>-f  c*  on  n 


IFCPND.LT  .XMIN)  then  do 
M-HM 
MM=MM+ 1 

mu*mh  KEEP  THE  BEST  PATH  AND  PND  ******  *  * « 

XM I N -  PND 
DO  30  I B  =  1 ,  10 
P(M,IB)-ZCIB) 

M  =  0 

END  IF 

DO  40  I K  =  1 , 10 
ZC I K  )  =SC IK+1 ) 

CONTINUE 

***********  CHANGE  THE  NEXT  CELL  ************* 
TT  =  TT* 1 

IFCTT.LE.il)  GO  TO  333 

***  IF  THERE  IS  AN  IMPROVEMENT , THEN  SET  S  **** 

*  T  0  THE  BEST  NEIGHBORHOOD  PATH  AND  START  AGAIN  * 

I  Ft  MM  GT  .  0  )  THEN  DO 
S  (  1  )  =  1 

DO  50  1=2.11 

SC  I  )=PC 1  .  I  -  1  ) 

2(1-1  )  =  P  (  1  ,  I  - 1  ) 

GO  TO  999 
END  IF 

*****  IF  THERE  IS  NO  IMPROVEMENT,  STOP  ******* 

PRINT ******  OPTIMAL  PATH  IS  ******* 

LlRITECo  ,  200  )  (SC  I  )  ,  1=2, 1  1  ) 

FORMAT ( 1012 ) 

PRINT , 'OPTIMAL  PND  IS', XMIN 

STOP 

END 

**************  CALCULATES  PND  **************** 

SUBROUTINE  PRO B ( Z . P B . T . NN . BB.PND) 

REAL  AC  50  )  ,PB( 50  )  , PND, BBC  50  ) 

INTEGER  NN.T.ZC50) 

K  P  =  T  - 1 

DO  71  K  =  1  . KP 
PBCSCK)  )  =0 

A(1)=.4»PB(1)+.2*PB(2>+.2*PB(4) 


AC  2  )  = 
AC  3  )  = 
AC  4  )  = 
AC  5  )  = 
AC6  )  = 
A  (  7  )  = 
AC  8  )  = 
A  (  9  )  = 


CON  T INUE 
P  b  (  S  C  T  )  )  =  0 
PND  0.0 
DO  5  1  K -  1  . NN 

P  N  D  =  P  N  D  ♦  P  B  (  K  ) 
CON  T I NUE 

DO  4.'  K  =  1  .  NN 
PBC  K  >  =  BBC  K  ) 

coni i nue 


. 4»PB( 1  )+ . 2*PB(  2  >  +  2  *  P  B ( 4  ) 
3»PB(1)+.4»PB(2)+.5*PB(3)+.15*PBC5) 

. 2»PB<  2  )  +  4  *  P  B ( 3 ) ♦ . 2*PB( o  ) 

. 3*PB( 1 )  + . 4*  PB ( 4 )  + . 15*PB( 5 )  + . 3*PB( 7  ) 

.2*PB(2)+.2*PB(4)+.4*PB(5)+.2*Ph(6)+.2*PB(8) 

.3*PB(3)+.15*PBC5)+.4*PB(6)+.3*PB(9) 

. 2  »  P  B ( 4  )+ . 4  *  P  B  C  7  )+ .  2  *  P  B  (  8  ) 
.15*Pb(5)+.3*PB(7)+.4*PBC8)+.S*T’B(9) 
2*PB(6)+.2*PB(8)+.4*PB(9) 

DO  72  I K -  1  . NN 
PBC IK ) -AC  IK  ) 

CONTINUE 


APPENDIX  B 

FOHTBAH  CODE  OF  P-»  ALGORITHH 


INTEGER  TIME.T.N.IH(9),A(9.9).S(10).CELL.Z(in 
REAL  R(9.9),X(9.10).V(9.11).PND.BB(9),PB(9) 
REAL  C( 9 , 1 0 ) . XM1N . P( 9 ,  I  0  ) 


*  INPUT  * 

T - T ! ME  PERIODS 
N  -  I?  0  F  CELLS 
5-STARTING  PATH 
in-rof  adjacent  cells 

A  = ADJACENT  CELLS 
R-TRANSITION  MATRIX 


R  E  A  D  (  5 , 1  0  0  )  T  ,  N 
FORMAT ( 212  ) 

READ (5. 101)  (SfI).I=l.T) 

FORMAT ( 1011) 

REA  DC  5 . 102)  (IN (I), 1-1,9) 

FORMA  T ( 9  I  1  ) 

READ( 5. 103)  C(A(I,J),J:1,N).I-1,N) 

FORMAT (Oil ) 

READ( 5 . 1 04)  ((R(I,J),J=1.N),I-1,N) 

FORMAT ( 9F3 . 2) 

»»»*»«**#***  DETERMINE  VCI.Jl'S  ************** 
CALL  V  F 1 N  D ( S , T , N , V ) 

DETERMINE  P(I.J)'S  ************** 

CALL  PFIND(S.T.P) 

DO  13  1  -  1  ,N 

PB( I  )  -P( I , 1  ) 

BB(I)-P(I»1) 

OMMiiou  DETERMINE  X(I,J)'S  ***  *  *«***»*«»  * 

CALL  X  F I ND( S , T , N , X ) 

•“*»*»»  FIND  PND  FUR  A  STARTING  PATH  ******** 

C  A l  I  P  R  0  B  ( S , PB , T , N. BB . PND ) 

XXMIN-PND 

FIND  NET)  EXTREME  POINT  ************* 

Z(  1  )  =  1 

CALL  CFIND(2,Z( 1  )  ,  IN.X.R. V, A.P.CELl ) 

l  (  2  )  '  C  E  L  L 

CALL  C  F  I  N  I)  (  3  .  Z  (  2  )  .  IN.X.R.V.A,P.CELL  ) 

L  (  3  )  -  C  E  l  L 

CALL  CF  I N  D ( 3 . Z(  5  )  , I N , X . R . V , A . P . CEL  L  ) 

2(A)  -CEL L 

CALL  CF IND( 4 , Z( A ) .  IN. X , R , V, A , P .CEL  L ) 


Z( 5 ) -CEL  L 

CALL  CFINDC5.ZC5). IN , X , R , V , A , P , CEL L ) 

Z  C  6  )  -  C  E  L  L 

CALL  CFIND(t>.Z(o  )  .  IN.X.R. V.A.P.CELL  ) 

Z ( 7 ) : CEL  L 

CALL  CFINDC7 , Z  C  7 ) ,  IN.  X. R . V, A, P. CELL  ) 

Z(8 )=CELL 

CALL  CF  IND( 8. Z( 8), IN.X.R. V.A.P.CELL ) 

ZC  9  )  =CEL  L 

CALL  CFI ND( 9. Z( 9). IN.X.R, V.A.P.CELL) 

Z(  1  0  )  =CEL  L 

CALL  CFINDC 10, ZC 10), IN.X.R. V.A.P.CELL ) 

Z( 1 1 )  =CEL  L 

******  FIND  PND  FOR  A  NEW  EXTREME  POINT  ****** 

CALL  PROB(Z.PB.T.N.BB.PND) 

*******  COMPARE  T NO  EXTREME  POINT'S  PND  ****** 

IF(PND.LT.XXMIN)  THEN  DO 

XXMIN=PND 

DO  9  U  I  - 1  ,  T 

scn-zu-H) 

*  DETERMINE  NEW  V(I,J)'S,  P(I.J)'S,  XCI,J)'S  * 

CALL  VFINDC5.T.N.V) 

CALL  PFIND(S.T.P) 

DO  11  I = 1 . N 
PB(I)-PCI.l) 

BB( I ) =P(  1 , 1  ) 

CALL  XFINDCS.T.N.X) 

GO  TO  999 
END  IF 

**  IF  THE  NEW  EXTREME  POINT  DOES  NOT  IMPROVE  ** 
********  THE  OBJECTIVE  FUNCTION,  STOP  ********* 

PRINT, 'MIN  PND  IS' .XXMIN 
PRINT,'******  OPTIMAL  PATH  IS  »»****' 

WRITE! 6 .600)  (S(I), 1-1,1) 

FORMAT ( 3X. 1012) 

STOP 

END 

»»**.*****»*  CALCULATES  V(I.J)'S  ************* 


SUBROUTINE  VFIND(S.T.N.V) 

REAL  V ( 9 , 1  1  ) 

INTEGER  SC  10), T 
DO  15  I  -  1 , N 

V(  I  ,  1  1  )  -  1  .  0 

J  =  T 
K- J  ♦  1 

V ( 1  ,  J  )  -  . 4*V( 1  . K )+ . 3*V( 2. K  )  + 

V  (  2  .  J  )  -  .2*V(1,K)+.4*V(2,K)+ 

V  C  3  ,  J  )  =  .3»V(2.K)+4*V(3.KM 
V ( 4  ,  J  )  -  . 2* V( 1  , K ) t  . 4 « V( 4 , K  )  ♦ 

V  C  5 , J  )  =  .15*V(2.K)+.  15«V( 

V  C  5 , J  )  -  V(5.J)*(15*V(6.C 

V  C  6  .  J  )  =  .  2 * V(  3  .  K  )  *  . 2*V( 5 

V  C  7  ,  J  )  -  .  3*V(4,K)+.4*VC7, 

V  (  8  ,  J  )  =  .2*V(5,K)+.2*V(7, 

V ( 9  ,  J  )  =  3  «  V  (  6  ,  K  )  + . 3  *  V ( 8 , 

V  (  S  (  J  )  .  J  )  -  0 
J  J  - 1 

I  Ft  J . GT . 0 )  GO  TO  25 
RETURN 


3  *  V  (  4  .  K  ) 

2  *  V  (  3  .  K  )  + 
•  V  ( i,  .  K  ) 

2  *  V  (  5  ,  K  )  * 


1  5  *  V  (  4  .  K  )  ♦  4  *  V  (  5  .  K  ) 


-  V(  5.J  )*(  15*V(6.K)*  .  ] 
=  . 2*V<  3 . K)+  . 2  *  V ( 5  ,  K  )  ♦ 

-  . 3*V(4,K)t.4*VC7,K)+ 

=  .2*V(5,K)+.2*V(7,K)+ 

=  3  «  V  (  6  ,  K  )  +  .  3  *  V  (  8  ,  K  )  * 


4  *  V  (  6  .  K  )  ♦ 

3  *  V  (  S  .  K  ) 

4  *  V  (  8  ,  K  )  ♦ 

4  * V(  9 , K  ) 


2  *  V  (  9 


nnn  o  n  o  noon 


END 


«*»«*«  CALCULATES  COST  COEFFICIENTS  AND  ****** 
************  SOLVES  LP  SUBPKObLLM  ***•****•»*« 

SUBROUTINE  CF1  NDC  TIME.  MM.  IN  .  X  .  R  .  V  .  A  .  f* .  CEL  L  ) 

REAL  RC9.9),VC9.11).PC9,10>.PP.CMIN,XC9.m.C(9.10) 
INTEGER  T TIME. TIME. MM. IN(9),A(9. 9 ) .CELL .MI .MK( 10 ) , LL 
CMI N= 1 
IK  =  INC  MM) 

TTIME-TIME+1 
DO  40  1=1 ,  IK 
J  =  A  ( MM , I ) 

PP  =  0 . 0 
IB-INCJ) 

I F( PC  J , TIME) .EQ. 0)  THEN  DO 
DO  5  5  11  =  1  -  IB 

PP=PP+R(J,ACJ, II ) ) *  V ( A  C  J . II ) . TT 1  ME  ) 

55  CONTINUE 

CCMM. J )=-( 0 . 0001 ) *PP 
ELSE  DO 

DO  56  11  =  1  .  IB 

PP  =  PP  +  RC  J . AC J . 1 1 ) ) *VC AC J . 1 1  >  .  TTIME  » 

56  CONTINUE 

C(MM, J )  =  - ( PC  J . TIME ) *PP) 

END  IF 

I  F C  C  C  MM . J ) . L  T . CM I N )  THEN  DO 
CMI N  =  C  C  MM, J ) 

CEL  L  = J 
END  IF 

40  CONTINUE 
RETURN 
END 

*************  CALCULATES  XCI,J)*S  ************ 

SUBROUTINE  XFINDC S, T , N, X) 

INTEGER  S ( 1 0 ) , T 
REAL  XC9.10) 

DO  60  1=1. T 
DO  7  0  J  =  1 , N 
X  (  J  ,  I  )  =  0 . 0 
70  CONTINUE 

60  CONTINUE 

DO  73  1=1 ,T 

78  XC  SC  I ) , I  )  =  l  .  0 

RETURN 
END 

************  CALCULATES  PND  ****************** 

SUBROUTINE  PROBCS-PB.T.N. BB.PNO) 

REAL  AA( 50 ) . PB( 9 ) . PND, BBC  9  ) 

INTEGER  N. T.S(  10) 

KP  =  T  -  1 

DO  7  1  K.  =  1  ,  KP 
P  B  (  S  (  K  )  )  =  0 

A  A (  1  )  =  4*PB(1)+.2‘PB<2>*.2*PB(4) 

A A ( 2  )  = .5  *  P  B( 1 ) ♦ . 4  *  P  B ( 2  > K 3  «  PB  (  3 ) *  .  1  5  *PB  (  5 ) 

A A ( S ) ‘  . 2  *  f  h ( 2  > ♦  . 4*PBC  3  >♦ . 2*  P  B ( o  ) 

A  A  (  4  )  =  .  3  *  P  B  (  1  )  ♦  .  4  *  P  B  (  4  >  ♦  .  1  5  *  P  b  (  5  )  ♦  .  3  *  P  B  C  7  ) 

A  A  C  5  )  =  .  2  *  P  B  (  2  )  ♦  .  2  *  P  B  (  4  )  ♦  .  4  *  P  B  (  5  )  t  .  2  «  P  B  ( t.  >  ♦  2  *  P  B  (  8  ) 
A  A  (  6  )  =  .  5  *  f  ’  B  C  3  )  +  1  5  »  P  B  (  5  )  *  4*P6(o>+.3*f'B(9) 

AA( / >  =  . 2»P  B<  4  > ♦  4  *PB( 7  )  f . 2*PfH  a  ) 

A  A  t  s  )  =  .  1  5  •  P  B  (  5  )  ♦  .  »  P  b  (  7  )  f  .  m  *  P  b  (  3  )  ♦  .  3  *  P  b  (  9  ) 

AA ( 9  )  = . 2  *  P B ( b ) ♦ . 2  « P B ( 8 ) + . 4  •  PB  (  9 ) 

DO  72  1K1-N 
P  B  (  IK  >  A  A  (  I  K  ) 

72  CONTINUE 


40 


71  CONTINUE 

PBC  SC  T  )  )  =  0 
PND-0 . 0 
DO  50  K-l  .  N 

PND=PND+PB(K) 

50  CONTINUE 

DO  42  K  =  1 , N 
PBC  K) =BBC  K ) 

42  CONTINUE 
RETURN 
END 
C 

C  (tint*********  CALCULATES  PCI,J)'S  xx*x*x**xxxxx 
C 

SUBROUTINE  PFINDCS.T.P) 

REAL  P(9, 10) ,PMC9, 10) 

INTEGER  S(10).T,M 
P( 9 . 1 )  =1  .  0 
PMC  9 , 1 )  =  1  .  0 
DO  85  1=1,8 
PMC  I , 1 )=0 

85  PCI,1)=0 
DO  80  J  =2 , T 
M  =  J  -  1 

PMC  SCM) ,M)=0 . 0 

PC  1 . J) = . 4*PMC 1 .M)+ . 2*PM(2,M)+ . 2*PM( 4,M> 

PC  2. J )= . 3*PM( 1 ,M)+ .4*PMC2,M)+ . 3*PM<  3.MJ+ . 15*PMC  5.M) 
PC  3, J)  = . 2  *  PM  C  2 , M ) + . 4  *  PM  C  3 ,  M ) +  . 2 x PMC  6 ,M) 

P ( 4 , J ) = . 3  xpM  C 1 , M ) + . 4  *  PMC  4  ,  M  )  +  .  1  5  *  PMC  5  .  M )  +  .  3  *  PMC  7 . M ) 
P(5,J)=.2*PMC2,M)+.2*PM(4,M)+.4*PMC5,M)+.2*PM(b,M) 
PCS, j:=PC5,J)*.2*PMC8,M) 

P  C  6 , J )  =  . 3  *  PM  C  3 , M ) + . 1 5  *  PMC  5,M)+.4*PMC6,M)+ .  3  *  PM  C  9 , M ) 
P ( 7 , J ) = . 2  *PMC  4,M)+.4*PM(7,M)+.2*PMC8,M) 
PC8,J>=.15*PMC5,M)+.3*PMC7,M)+.4*PMC8.M)+.3*PMC9,M) 
PC  9, J)  = . 2*PM( 6 , M ) + . 2xPM( 8 . M ) + . 4*PMC  9 , M ) 

DO  86  1=1,9 

86  PMC  I, J)=P(I, J) 

80  CONTINUE 

RETURN 

END 

C 

C  *********  * x*** * x*  INPUT  DATA  ***************** 

c 

10  9 

4565856585 

343454343 

124000000 

123500000 

236000000 

145700000 

245630000 

356400000 

478000000 

578900000 

689000000 

040030000030000000000000000 
020040020000020000000000000 
0  0  0  0  3  0  0  4  0  0  0  0  0  0  0  0  3  0  0  0  0  0  0  0  0  0  0 
020000000040020000020000000 
000015000015040015000015000 
0  0  0  0  0  0  0  2  0  0  0  0  0  2  0  0  4  0  0  0  0  0  0  0  0  2  0 
00 00 000000 30 00 000004 0U30 000 
0  0  0  0  0  0  0  0  0  0  0  0  0  2  0  0  0  0  0  2  0  0  4  0  0  2  0 
0  0  00000000  0  0 0  0 0  0 500  0  00  30  u 4  0 
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